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Abstract 

Background: Informed consent is regarded as a cornerstone of ethical healthcare research and is a requirement for 
most clinical research studies. Guidelines suggest that prospective randomised controlled trial (RCT) participants 
should understand a basic amount of key information about the RCTs they are being asked to enrol in in order to 
provide valid informed consent. This information is usually provided to potential participants in a patient 
information leaflet (PIL). There is evidence that some trial participants fail to understand key components of trial 
processes or rationale. As such, the existing approach to information provision for potential RCT participants may 
not be optimal. Decision aids have been used for a variety of treatment and screening decisions to improve 
knowledge, but focus more on overall decision quality, and may be helpful to those making decisions about 
participating in an RCT. We investigated the feasibility of using a tool to identify which items recommended for 
good quality decision making are present in UK PILs. 

Methods: PILs were sampled from UK registered Clinical Trials Unit websites across a range of clinical areas. The 
evaluation tool, which is based on standards for supporting decision making, was applied to 20 PILs. Two 
researchers independently rated each PIL using the tool. In addition, word count and readability were assessed. 

Results: PILs scored poorly on the evaluation tool with the majority of leaflets scoring less than 50%. Specifically, 
presenting probabilities, clarifying and expressing values and structured guidance in deliberation and communication 
sub-sections scored consistently poorly. Tool score was associated with word count (r = 0.802, P <0.01); there was no 
association between score and readability (r = —0.372, P = 0.106). 

Conclusions: The tool was feasible to use to evaluate PILs for UK RCTs. PILs did not meet current standards of 
information to support good quality decision making. Writers of information leaflets could use the evaluation tool as a 
framework during PIL development to help ensure that items are included which promote and support more 
informed decisions about trial participation. Further research is required to evaluate the inclusion of such information. 
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Background 

Informed consent forms the cornerstone of ethical require- 
ments in healthcare research [1,2]. In the context of health- 
care research, the giving of informed consent signifies that 
an individual has made an informed and voluntary decision 
about their participation in a research study. Randomised 
controlled trials (RCTs) usually require all participants to 
sign an informed consent document indicating that they 
have understood the information they have been provided 
with before they commence participation in the trial [1]. 

To assist in making an informed decision about partici- 
pation, potential trial participants in the UK are provided 
with a patient information leaflet (PIL) that contains infor- 
mation about the RCT. The information included in PILs 
is guided by the Declaration of Helsinki, the International 
Conference on Harmonisation Good Clinical Practice 
(ICH GCP) and also by national guidance such as the 
National Research Ethics Service (NRES) [1,3,4]. As defined 
by the guidance, the PIL should include, at minimum, in- 
formation about: the purpose of the trial; procedures; inter- 
ventions; possible risks and benefits; sources of finance; 
potential conflicts of interest; and the researcher's affiliation 
[1,3]. The guidance for informational requirements covers 
predominantly fact-based information and is standardised 
at a population level [1,3]. 

Currently the PIL and consent form are the only com- 
ponents of the consent decision making process for RCTs 
that are formally regulated, through specific guidance, and 
reviewed by ethics committees or internal review bodies 
[1]. However, as with decisions about treatment, potential 
participants vary in the amount of information they desire 
when faced with a decision about trial participation [5-7]. 
As such, within a trial context where the information mini- 
mum has been pre-determined by the guidance [1,3,4], 
many potential participants' preferences for information 
may be exceeded [6] and other approaches to supporting 
decision making may be required. Despite this, there is evi- 
dence that some trial participants, both those considering 
participation and those actively enrolled in clinical trials, fail 
to understand key components of the trial processes or 
rationale [8-10]. This has ranged from misunderstandings 
about: risks [11]; the right to withdraw [11]; confidentiality 
[12]; side effects [13]; and purpose of the trial [14]. This 
suggests that in the context of trial participation, existing 
approaches to information provision may be sub-optimal 
and some decisions may not have been based on a full 
understanding or consideration of all the relevant issues. 
This may be because the information is too complex or 
not designed to support an informed decision but rather 
to present factual information to the potential participant. 
A range of studies have explored ways of improving infor- 
mation, and have tended to focus on the content and 
structure of the information [8]. For example: the length 
of the information sheet, that is, short versus long leaflets 



[10,15]; simplified or enhanced versions of the same 
PIL [16,17]; patient-specific information versus generic 
information [18,19]; linguistic analysis of leaflets [20]; 
consumer involvement in development of PILs [21]; audio- 
visual information [22]; computer-based information [23]; 
and user testing to improve content [24]. 

As discussed above, the literature to date has tended 
to focus on the provision of information, to improve 
understanding about trial processes, with the aim of 
making the consent process more 'informed'. How- 
ever, informed decision making in the context of trial 
participation is a complex process and requires more 
than just greater understanding or comprehension of 
certain fact-based information. For example, key con- 
siderations which are regarded by established theories 
of decision making as being important for making 
'good' decisions (for example considering the alternatives 
(for example standard care and what that is), making 
trade-offs and evaluating potential outcomes of the de- 
cision [25]) might not be presented or discussed at all 
during the informed consent discussion or explicit in 
the PIL. These omissions may stem from the conven- 
tional conceptualisation of trial participation as an act 
of 'informed consent'. This conceptualisation likely re- 
lates to the ethical and regulatory requirements, rather 
than viewing deliberations and decisions about partici- 
pation as broader and more complex [26]. 

Decision aids have been developed for a variety of treat- 
ment and screening decisions as a means of improving 
'informed decisions' in particular contexts and across the 
decision making process [25]. These decision aids provide 
information about: the available options and any associ- 
ated outcomes; personalise information by including exer- 
cises to help patients think about what matters most to 
them; and provide ways of communicating this with the 
healthcare professional to reach a decision [25]. There is 
substantial evidence to suggest that decision aids can 
positively influence outcomes, such as: improving know- 
ledge, especially when there is clinical equipoise; providing 
accurate perceptions of outcome probabilities; and align 
preferred outcomes with the choice made [25]. 

As discussed previously, the traditional conceptualisation 
of informed consent in RCTs is as a behaviour relating to 
understanding rather than promoting informed decisions. 
This may have led to the information contained within PILs 
being focussed on fact-based trial information rather than, 
for example, what trial participation might mean for that 
individual. Yet, these personal considerations do play a sig- 
nificant role for people when deciding whether or not to 
participate in a trial [27] and this is often the type of infor- 
mation contained within treatment decision aids. As such, 
it is perhaps timely to re-think the way in which decisions 
about trial participation and discussions about informed 
consent are supported. 



Gillies etal. Trials 2014, 15:62 
http://www.trialsjournal.eom/content/15/1/62 



Page 3 of 10 



Preliminary studies exploring the potential of decision 
aids for use in the informed consent process for RCTs 
have shown promise in that they appear to improve as- 
pects of the decision making process [28-32]. Decision 
aids to support decisions about trial participation have 
been shown to be acceptable and valued by potential 
participants [28,29]. In these studies, the decision aid 
was a substitute for the existing PIL and contained all 
of the required information expected to be in a PIL in 
addition to those expected to be in a decision aid. Specific- 
ally, decision aids in this context have been shown to im- 
prove understanding about the trial and its associated 
interventions [28,29], produce low levels of decision conflict 
[29] and not raise anxiety [28,29]. However, these studies 
had small sample sizes and were set within a hypothetical 
trial context. As such, the need for further research has 
been noted [28-32]. A recent study examined the extent to 
which existing informed consent documents conform to 
standards for encouraging good quality decision making as 
laid out by International Patient Decision Aid Standards 
(IPDAS) [33,34]. The evaluation tool used in the study by 
Brehaut and colleagues contained two sections: a series of 
items derived from the IPDAS and a set of items derived 
from published guidance on informed consent [34]. Only 
the first section of the tool, including items developed from 
the IPDAS, was used and the majority of the included PILs 
were developed in the US with approximately half being for 
cancer trials [34]. Guidance for US PILs differs from that 
for UK PILs with regard to whether specific information is 
presented in either the information sheet or consent 
form, with UK consent forms being a one-page document, 
whereas US consent forms are longer and contain much of 
the information contained within the UK PIL. Moreover, 
the study by Brehaut and colleagues did not assess word 
count or readability, both of which can contribute to under- 
standing of information and length of document. 

Previous research has suggested that decision aids for 
trial participation have the potential to promote good 
quality decision making [28,29] and specific components 
of decision aids that have been applied in RCTs have 
also offered promise [30,35]. Therefore, this study aimed 
to assess the feasibility of assessing the extent to which 
items considered important in decision aids are present 
in existing UK PILs. We used the complete evaluation tool 
(developed by Brehaut et al. [34]), alongside word count 
and readability 'calculators! to evaluate PILs across a range 
of clinical conditions in a UK context. 

Methods 

Sample of patient information leaflets 

We screened the websites of 48 UK Clinical Research 
Collaborations registered (full or provisional) Clinical Trial 
Units (CTUs) for publicly available PILs from recently 
completed or on-going RCTs. Eighteen CTUs provided 



copies of such PILs on their websites. The CTU based in 
the Institute of the lead researcher (KG) also provided PILs 
for the study. The total population of publicly available 
CTU PILs was 60. The following inclusion criteria were 
applied to the population of 60 PILs: PILs for a RCT that 
was on-going or completed after 2001 (to coincide with the 
introduction of the European Clinical Trials Directive 
2001/20/EC [36]); PILs designed for a primary RCT, that is, 
not a follow-on study; and PILs designed for competent 
adults making a decision about their own participation, not 
proxy decision makers. PILs that were designed for cluster 
RCTs, emergency research with retrospective consent and 
RCTs recruiting children or healthy volunteers were ex- 
cluded from the study. Subsequently, PILs were sampled 
purposively, from the identified population of 60, to allow 
for variation in intervention and CTU. Four main interven- 
tion groups were identified: drug; surgical; cognitive; and 
other (which included physiotherapy studies and smoking 
cessation trials). A final sample of 26 was purposively 
selected for: initial evaluation tool feasibility assessment 
(n = 1); pilot (n = 5); and full analysis (n = 20). 

Evaluation tool 

Development of the evaluation tool has been described 
elsewhere [34]. In brief, the tool is divided into two sec- 
tions: items derived from the IPDAS (Section A, 32 items) 
and additional items derived from published guidelines for 
informed consent (Section B, 27 items) [34]. The two sec- 
tions are made up of a total of 59 items. 

Data collection 

For the purposes of this study, the study team (KG, WH, 
ZS and SC) carried out an initial evaluation of one PIL 
to assess whether it was feasible to use the tool to assess 
PILs from UK RCTs. This was necessary as the tool was 
developed based on the informational requirements for 
US and Canadian PILs [34], which differ from UK 
guidelines with regard to whether specific information 
is presented in the information sheet or consent form. 
The team then discussed items for meaning and clarifi- 
cation and developed a coding 'manual', which con- 
tained detailed description of rules for coding, to assist 
in the analysis (for example, see Additional file 1). In 
developing the coding manual we opted to rate items 
using a two-point scale, rather than the four-point 
scale originally reported. This approach was taken as it 
is difficult to make a clear distinction between both 
strongly agree and agree, and strongly disagree and 
disagree. The two-point scale was defined as follows: 
'agree' (that is, information was present) or 'disagree' 
(information was absent), with some items (n = 5) including 
a 'not applicable' option. Two researchers (KG and WH) 
carried out further pilot assessment using the amended 
scale. They independently rated five PILs using the tool and 
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then compared their scores to identify areas of divergence, 
which were then discussed by the study team and used to 
further refine the coding manual. Changes to the coding 
manual following this pilot stage included clarifying the 
focus for each question, for example question 1: 'On the 
first page of the PIL there is a description that potential 
participants need to make a decision about whether or 
not to participate in the trial'. The focus for this question 
was determined as 'potential participants need to make 
a decision' and the PIL was required to state this expli- 
citly (for example you need to make a decision about 
whether or not to participate) rather than implicitly, 
through wording such as 'you are being invited to par- 
ticipate in a trial'. Further details on items included in 
the tool and the coding rules associated with them can 
be seen in Additional file 1. The evaluation scores gen- 
erated from the five PILs included in the pilot stage are 
not reported. 

The 20 PILs sampled for full analysis were rated inde- 
pendently using the tool by two members of the research 
team (KG and WH). Evaluation scores for each PIL were 
recorded and discrepancies were resolved using a third 
researcher (SC) and the majority decision recorded. 

Readability scores were calculated using an online Flesch- 
Kincaid readability calculator [37]. The Flesch-Kincaid 
algorithm is based on word length and sentence length, 
where higher scores indicate material that is easier to 
read and lower scores indicate material that is harder 
to read, with scores being presented out of 100 [37]. Word 
count was measured using the appropriate function in 
Microsoft Word. Correlation coefficients were used to test 
the relationship between readability and tool score, and 
word count and tool score. 

Analysis 

Items on the tool were scored as follows: agree = 1 and 
disagree = 0. Therefore, the maximum evaluation score 
for a PIL was 59. Where the 'not applicable' option was 
selected, the item was not scored and, for the calculation 
of percentage score, the denominator was reduced by 
1. Data from the evaluation tool scores were presented 
as raw data and as percentages. Higher scores indicate 
PILs which performed better when applying the evalu- 
ation tool. 

Inter-rater reliability between the two independent 
researchers was assessed for the final sample of 20 PILs 
using unweighted Cohen's kappa. Pearson correlation 
coefficients were calculated using IBM SPSS Statistics 
(IBM Corporation, Armonk, NY, USA), and used to 
test the relationship between readability and tool score, 
and word count and tool score. A one-way ANOVA, 
calculated using IBM SPSS Statistics, was used to test 
differences in mean group scores between the inter- 
vention groups. 



Results 

Patient information leaflets 

The 20 PILs included in the final analysis contained five 
PILs from each of the intervention groups; drug; surgical; 
cognitive; and other. PILs from all 19 CTUs were included 
in the final sample and the majority of PILs (16/20) were 
produced on, or after, 2006 (Additional file 2). 

Evaluation scores 

Inter-rater reliability was confirmed with an overall 
mean kappa score of 0.846. There was variability in total 
evaluation scores across the sample (Table 1). The high- 
est evaluation score recorded was 38 (64%), while the 
lowest was 19 (33%). Thirteen (65%) PILs scored a total 
of 50% or less. 

The evaluation scores for Section A ranged from 16% 
to 41%. Evaluation scores for Section B were higher, 
ranging from 46% to 91%. There were sub-sections 
within Section A that scored consistently poorly. These 
were: presenting probabilities; clarifying and expressing 
values; structured guidance in deliberation and communi- 
cation; and using evidence. The 'presenting probabilities' 
sub-section, which contains eight items, was scored as 
'0' across all PILs and as such was the worst performing 
sub-section. 

There was no statistically significant difference (P = 0.119) 
in mean evaluation scores between intervention groups 
(Table 2). Similarly, there was no statistically significant 
difference in mean evaluation scores between intervention 
groups for Section A (P = 0.097) or Section B {P = 0.209) 
(Table 2). 

Evaluation score and readability 

Readability scores ranged from 49 to 75 with a mean score 
of 60.8 (SD = 6.4) (scores of 60 to 70 suggest understanding 
by 13- to 15-year-olds). There were no statistically sig- 
nificant differences in mean readability scores between 
the intervention groups (P = 0.449; Table 2). Readabil- 
ity did not correlate with evaluation score (r = -0.372, 
P = 0.106; Figure 1). 

Evaluation score and word count 

Word count ranged from 698 to 4,138 words, with a 
mean word count of 1,853 (SD = 960). There were no 
statistically significant differences in word count between 
intervention groups (P = 0.224; Table 2). However, un- 
like readability, word count had a positive correlation 
with evaluation score and was statistically significant 
(r = 0.802, P <0.01; Figure 2). 

Discussion 

This study evaluated PILs from UK RCTs using an 
evaluation tool based on the IPDAS [33] and informed 
consent guidelines. 
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(n/10) (n/5) 
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Drug interventions 
























01 31 (53%)* 
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0 1 
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5* 
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02 26 (45%)* 


9 (28%) 


1 7 (65%)* 
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0 
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0 1 


3 


6 3 


3 


4* 


1 


03 38 (64%) 


13 (41%) 


25 (93%) 


6 


o 
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1 2 


3 


9 4 


5 


6 


1 


04 29 (50%)* 


9 (28%) 


20 (77%)* 


4 


o 


o 


0 1 


4 


8 3* 


3 


5 


1 


05 33 (57%)* 


11 (34%) 


22 (85%)* 


6 


o 


o 


1 1 


3 


10 3 


3 


5* 
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Surgical interventions 






















06 33 (56%) 


1 2 (38%) 


21 (78%) 
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o 
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0 1 


4 


8 4 


3 


5 


1 


07 19 (33%)* 


7 (22%) 


1 2 (46%)* 


2 


o 


o 


1 1 


3 


3 2 


1 


5* 


1 


08 26 (44%) 


8 (25%) 


1 8 (67%) 


2 


o 


o 


1 1 


4 


7 3 


4 


4 




09 33 (56%) 


10 (31%) 


23 (85%) 


4 


o 


o 


1 1 


4 


9 3 


A 


6 


1 


1 0 24 (41 %)* 


6 (1 9%) 


1 8 (69%)* 


3 


o 


o 


0 1 


2 


5 3 


A 


5* 


1 


Cognitive interventions 






















1 1 23 (40%)* 


6 (1 9%) 


1 7 (65%)* 


2 


o 


o 


0 1 


3 


8 1 


3 


4* 


1 


1 2 26 (46%)** 


7 (22%) 


1 9 (76%)** 


I 


o 


o 


1 1 


4 


8 1* 


A 


5* 


1 


13 21 (37%)** 


5 (16%) 


1 6 (64%)** 


3 


o 


o 


0 0 


2 


7 0* 


3 


5* 


1 


14 23 (40%)* 


7 (22%) 


1 6 (62%)* 


3 


o 


o 


0 1 


3 


7 1 


3 


4* 


1 


1 5 28 (48%)* 


11 (34%) 


1 7 (65%)* 


/ 


0 


0 


0 1 


3 


8 0 


3 


5* 
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1 6 24 (42%)** 


6 (1 9%) 


18 (72%)** 


2 


0 


0 


0 1 


3 


7 2* 


3 


5* 


1 


17 31 (54%)** 


10 (31%) 


21 (84%)** 


5 


0 


0 


0 1 


4 


9 2* 


A 


5* 




1 8 22 (39%)** 


6 (1 9%) 


16 (64%)** 


2 


0 


0 


0 1 


3 


6 2* 


2 


5* 




1 9 30 (53%)** 


9 (28%) 


21 (84%)** 


4 


0 


0 


1 2 


2 


9 2* 


A 


5* 




20 22 (39%)** 


5 (16%) 


1 7 (68%)** 


2 


0 


0 


0 0 


3 


7 2* 


2 


5* 




*Denominator for overal 


score, and Section B, reduced by 1 (n = 58 and n 


= 26, respectively) due to scoring one item as not applicable; **denominator for overall 


score, and Section B, reduced by 2 (n = 57 and n 


= 25, 



respectively} due to scoring two items as not applicable. 
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Table 2 Comparison of intervention group mean scores 


Mean 




Intervention group 




P value 




Drug 


Surgical 


Cognitive 


Other 




Overall score (SD) 


31 (5) 


27 (6) 


24 (3) 


26(4) 


0.119* 


Section A score (SD) 


10(2) 


9(2) 


7 (2) 


7 (2) 


0.097* 


Section B score (SD) 


21 (4) 


18(3) 


17(1) 


19(2) 


0.209* 


Readability (SD) 


57.8 (5.6) 


59.9 (4.0) 


60.8 (8.0) 


64.5 (7.4) 


0.449* 


Word count (SD) 


2,572 (1,197) 


1,896 (979) 


1,523 (623) 


1,422 (754) 


0.224* 



P, statistical significance of ANOVA test of scores across intervention groups; SD, standard deviation. *Not statistically significant. 



We assumed that all included PILs had been reviewed 
by an ethics committee and had been given a favourable 
opinion. Despite this, we found that the majority of PILs 
did not perform well using the tool (based on a score of less 
than 50%). All the PILs scored more poorly on Section A as 
compared to Section B. Our results provide an indication 
that information shown to support high quality decision 
making in other contexts is lacking in PILs for UK RCTs. 
There were four sub-sections in Section A that scored 
consistently poorly across all leaflets. These sub-sections 
were: presenting probabilities; clarifying and expressing 
values; structured guidance in deliberation and commu- 
nication; and using evidence. This was not surprising 
given these concepts are not currently included in the 
informed consent guidance [1,4]. However, the items 
reflect standards that have been shown to be important to 
promote high quality decisions for treatment and screening 
[25] and identify items that have also been shown to be im- 
portant to trial participants during their trial participation 
experience [27]. Moreover, our findings are mirrored in a 



similar study by Brehaut and colleagues, who also demon- 
strate an absence or lack of detail related to these items in 
PILs developed for trials in other contexts [34]. Perhaps 
also unsurprisingly, in our study, scores for Section B were 
better than scores for Section A. This is perhaps because 
many of the items included in Section B are present within 
the current guidelines for informed consent documents 
[1,3]. Our findings suggest that the information presented 
in PILs to date has tended to focus on key elements of 
the RCT rather than supporting the process for decision 
making. As highlighted earlier, arguably this relates to 
conceptualisations of trial participation as being merely an 
act or a process of informed consent. As such, we propose 
reconsideration of the purpose of PILs and their role in the 
informed consent process. We would support a move to a 
more informed decision making process which encourages 
potential participants to assess what matters to them and 
how trial participation relates to them personally as individ- 
uals. This study provides further evidence that PILs do 
not include information that has been shown to improve 
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Figure 1 Correlation of readability and overall score. 



readability 
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words 



Figure 2 Correlation of word count and overall score. 



decision making in other contexts. As such, this could 
suggest that poor quality decisions are being made about 
trial participation and indicates room for improvement. 

There is evidence that some of the items identified as 
lacking from PILs, which were measured in Section A, 
may have an important role to play in decision making 
for participation in RCTs. For example, the section on 
'presenting probabilities' was lacking in most PILs, but 
aspects of this concept have been shown to be important 
for decisions about trial participation. In a recent study, 
parents were faced with a hypothetical decision about 
inclusion of their child in a RCT of paediatric postop- 
erative pain control. Parents who received probabilistic 
risk information in pictograph form (a diagram that 
conveys meaning through pictorial resemblance) under- 
stood the information better than those who received 
information as words or tables [35]. Also, exercises to 
help patients clarify and express their values, that is, to 
determine what matters most to them, have been shown 
to play a potentially important role in decision making for 
potential RCT participants [30]. A recent study provided 
potential participants with values clarification exercises 
when considering participation in a hypothetical trial for 
breast cancer treatment [30] . These exercises were found 
to be beneficial in this context as they enabled effective 
deliberation about the decision by lowering ambivalence 
and decisional uncertainty and improving the clarity of 
personal values [30]. Such exercises were also identified 
as lacking in the PILs in this study. Lastly, another of the 
areas which scored consistently poorly across the PILs 
was structured guidance in deliberation and communi- 
cation. This type of information could be incorporated 



by including text such as 'take time to think about how 
you would feel if you received treatment A rather than 
treatment B, and how the possible side effects of each 
would affect you personally' and 'think carefully about 
your decision to participate and how it might impact on 
your life, take time to discuss with family and friends] and 
so on. However, the impact and usefulness of such infor- 
mation requires investigation. To our knowledge there is 
no published research into using structured guidance in 
deliberation and communication within RCT PILs. 

There was no correlation identified between readability 
and tool score. Interestingly, the average readability level 
of the PILs in this study (13 to 15 years) is well above the 
estimated reading age of the UK population in general 
(9 years) [38]. It is worth noting that readability formulae 
(such as Flesch-Kincaid) have limitations in that they 
test 'structure and composition' rather than meaning 
or context. In addition they do not take into account 
additional influences on 'readability' such as layout, ap- 
pearance, print size, and use of diagrams [38]. However, 
there was a significant correlation between word count 
and tool score. This may be expected as longer PILs can 
incorporate more information and thus potentially score 
higher on the evaluation tool. We are not, however, pro- 
moting the lengthening of existing PILs, which have 
previously been noted as getting longer whilst not ne- 
cessarily improving understanding [39]. It is possible to 
write shorter PILs whilst improving the overall evalu- 
ation score and being in accord with current guidance 
from ethics committees, as evident from some of the 
PILs included in this study. For example, PIL01 and 
PIL17 (word count 1,500 to 2,000) scored higher than 
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others containing substantially more words (PIL04 and 
PIL15 (word count 2,500 to 3,000)). It may be that the 
tool should include consideration of word count to ac- 
commodate any effect of the number of words in the 
PIL. Therefore, it may be helpful to develop a frame- 
work from the evaluation tool for those writing PILs for 
RCTs to encourage them to include text that might fa- 
cilitate better quality decisions which are more aligned 
with promoting 'informed' consent. 

Strengths and limitations 

The primary strength of this study is that it investigated 
the content of a sample of UK PILs, considering the ex- 
tent to which they contained key information which is 
known to support decision making in other contexts. A 
further strength of the study is that each PIL was scored 
by two researchers independently, so as not to introduce 
rater bias. This study is the first to report the use of 
Section B of the tool which was developed with the 
specific aim of assessing consent forms in a US and 
Canadian context. As discussed earlier, consent forms 
for US trials are often considerably longer than those 
in the UK (where they are generally a single page) and 
much of the information contained within US consent 
forms would be found in a PIL in the UK. Therefore, 
we felt it was appropriate to use both sections of the 
tool to assess UK PILs. 

We undertook this study as a feasibility study to assess 
whether the tool could be used to evaluate PILs from 
UK-based RCTs, and as such, our sample was small. 
Although taken from a convenience sample, PILs were 
sampled purposively to ensure that there was represen- 
tativeness of CTUs (so as not to introduce any bias 
from developers) and intervention type across the sam- 
ple. As we sourced only publicly available PILs from 
CTU websites, the number of PILs identified is likely 
to be much smaller than the number of RCTs on-going 
or recently completed in the UK. Moreover, CTUs may 
be selective with regard to which PILs they make publicly 
available on their websites. Despite these potential limita- 
tions, we found both variability in scores between PILs and 
consistency in terms of which sub-sections the PILs scored 
poorly on. This suggests that our findings may be generalis- 
able, and have relevance to a wider range of PILs for UK 
RCTs. We restricted our sample to PILs dated from 2001 
onwards (to align with the introduction of the European 
Clinical Trials Directive [36]). Although it is possible that 
PILs written more recently may score better on the tool, 
pardy because of updates to UK guidance [4], we did not 
find evidence of an association between year of publication 
and tool score (r = -0.136, P = 0.566). In addition, the 
majority of the PILs included in our study (16/20) were 
produced after 2006, and so are likely to conform to the 
most recent UK guidance documents [4]. 



Key recommendations 

As is evident from existing studies, changing the struc- 
ture of information contained within PILs often has little 
or no effect on knowledge or understanding. However, 
the findings from this study support new ways of thinking 
about the information to include in a PIL, which may be 
more encompassing for supporting high quality decision 
making, and as such, more aligned with the process of 
'informed' decision making relating to consent. There- 
fore to improve decision quality with regard to making 
decisions about trial participation, it may be important 
to incorporate, or at least consider inclusion of, these 
items into PILs. The preliminary findings from other 
studies do offer promise for the use of decision aids, 
and associated aspects, within the context of informed 
consent for clinical trials [28-30,35]. We believe there 
may be potential benefit from the use of decision aids 
in this context. However, there is currently insufficient 
evidence to propose a definitive model to improve the 
existing process such that it aligns more with 'informed 
decisions' for trial participation or to recommend writing 
PILs to IPDAS standards. At present, suggestions for 
researchers could be to evaluate their own PILs using 
the tool, equivalent frameworks developed from the 
IPDAS or explore those items identified in this study 
as lacking from existing PILs. Any areas which score 
poorly could be supplemented before the PILs are used in 
the informed consent process and piloted with potential 
participants to discuss support for decision making. How- 
ever, before this could be implemented, empirical studies 
assessing whether any of these items are associated with 
an improvement in decision making are required. 

It should be recognised that PILs form only one piece 
of the jigsaw for supporting decisions about trial partici- 
pation and that decision making in this context is often 
influenced by much more than just the provided informa- 
tion [27]. We propose that existing PILs need to be re- 
placed, or supplemented, with interventions that are more 
suited to supporting informed decision making. This may 
be a decision aid but may also be a strategy for improved 
communication. It is worth noting that more informed 
decisions about participation in RCTs may impact either 
negatively or positively on both recruitment and retention 
within a study. We postulate that participants who are 
more fully informed at the outset and more aware of the 
likely expectations on them throughout their participation 
experience may be less likely to drop out, but this remains 
to be determined empirically. 

Engagement with key stakeholders such as ethics com- 
mittees, policy makers, patients and trialists could help 
to incorporate the findings from this research into the 
development process for PILs, and pave the way for new 
ways of thinking about supporting informed decisions in 
the context of RCT participation. 
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Conclusions 

We have shown that the evaluation tool can be used to 
assess whether or not PILs from UK RCTs include items 
recommended for good quality decision making. Existing 
PILs for participation in UK RCTs fulfil ethics committee 
guidelines [1], yet we found that many were lacking in 
items deemed to be important for promoting high quality 
decisions. Future research could explore the potential 
value of the type of information identified as lacking from 
existing PILs and whether this would better support po- 
tential participants to make high quality decisions about 
participation in RCTs. 

Additional files 



Additional file 1: Example from coding manual. The text illustrates an 
example from the manual that raters used to code patient information leaflets. 

Additional file 2: Description of trials included in patient 
information leaflet sample. The text illustrates contextual information 
of patient information leaflets included in the study. 



Abbreviations 

ANOVA: Analysis of variance; CTU: Clinical Trial Unit; GCP: Good Clinical 
Practice; ICH: International Conference on Harmonisation; IPDAS: Internationa 
Patient Decision Aid Standards; NRES: National Research Ethics Service; 
PIL: Patient information leaflet; RCT: Randomised controlled trial. 

Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

KG conceived the study, carried out the analysis of PILs, contributed to data 
analysis and led the writing of the manuscript. WH carried out the analysis of 
PILs and contributed to data analysis. ZS and SC both participated in the 
design of the study and coordination and helped to draft the manuscript. JB 
developed the original evaluation tool. All authors read and approved the 
final manuscript. 

Acknowledgements 

The authors would like to thank Andrew Elders for statistical advice on 
certain aspects of the analysis. 

The Health Services Research Unit is supported by a core grant from the 
Chief Scientist Office of the Scottish Government Health and Social Care 
Directorates. The views and opinions expressed therein are those of the 
authors and do not necessarily reflect those of the Chief Scientist Office or 
the Department of Health. 

Author details 

'Health Services Research Unit, University of Aberdeen, Health Sciences 
Building, Foresterhill, Aberdeen AB25 2ZD, UK. 2 Clinical Epidemiology 
Program, Ottawa Hospital Research Institute, The Ottawa Hospital, General 
Campus, 501 Smyth Road, Centre for Practice-Changing Research, Box 201 B, 
Ottawa, ON KIH 8L6, Canada. 

Received: 23 July 2013 Accepted: 24 January 2014 
Published: 18 February 2014 

References 

1 . World Medical Association (WMA): WMA Declaration of Helsinki: Ethical 
Principles for Medical Research Involving Human Subjects. Ferney-Voltaire: 
WMA; 2008. http://www.wma.net/en/30publications/10policies/b3/index.html. 

2. Beauchamp TL, Childress JF: Principles of Biomedical Ethics. Oxford: Oxford 
University Press; 1994. 



3. International Conference on Harmonisation (ICH): ICH Harmonised 
Tripartite Guideline: Guideline for Good Clinical Practice E6(Ri), Step 4 
version. Geneva: ICH; 1996. 

4. National Research Ethics Service (NRES): Information Sheet and Consent 
Forms: Guidance for Researchers and Reviewers. London: National Health 
Service, National Patient Safety Agency; 2009. 

5. Wade J, Donovan JL, Lane JA, Neal DE, Hamdy FC: It's not just what you 
say, it's also how you say it: opening the 'black box' of informed consent 
appointments in randomised controlled trials. Soc Sci Med 2009, 68:201 8-2028. 

6. Antoniou EE, Draper H, Reed K, Buris A, Southwood TR, Zeegers MP: An 
empirical study on the preferred size of the participant information 
sheet in research. J Med Ethics 201 1, 37:557-562. 

7. Brown RF, Shuk E, Butow P, Edgerson S, Tattersall MH, Ostroff JS: Identifying 
patient information needs about cancer clinical trials using a Question 
Prompt List. Patient Educ Couns 201 1, 84:69-77. 

8. Flory J, Emanuel E: Interventions to improve research participants' 
understanding in informed consent for research: a systematic review. 
JAMA 2000, 6(292): 1 593-1 601. 

9. Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Cothart IR, 
Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and 
progress of randomised controlled trials. Health Technol Assess 1999, 3:1-143. 

10. Sand K, Loge JH, Berger O, Gronberg BH, Kaasa S: Lung cancer patients' 
perceptions of informed consent documents. Patient Educ Couns 2008, 
73:313-317. 

1 1 . Canvin K Jacoby A: Duty, desire or indifference? A qualitative study of patient 
decisions about recruitment to an epilepsy treatment trial. Trials 2006, 7:32. 

12. Estey A, Musseau A, Keehn L: Patient's understanding of health information: 
a multihospital comparison. Patient Educ Couns 1 994, 24:73-78. 

13. Griffin JM, Struve JK, Collins D, Liu D, Nelson DB, Bloomfield HE: Long term 
clinical trials: how much information do participants retain from the 
informed consent process? Contemp Clin Trials 2006, 27:441-448. 

14. Itoh K, Sasaki Y, Fujii H, Ohtsu T, Wakita H, Igarashi T, Abe K: Patients in 
phase I trials of anti-cancer agents in Japan: motivation, comprehension 
and expectations. Br J Cancer 1997, 76:107-113. 

15. Kruse AY, Kjaergard LL, Krogsgaard K, Gluud C, Mortensen EL, Gottschau A, 
Bjerg AM: A randomised trial assessing the impact of written information 
on outpatients' knowledge about attitude toward randomised clinical 
trials. The INFO trial group. Control Clin Trials 2000, 21:223-240. 

16. Murphy DA, O'Keefe ZH, Kaufman AH: Improving comprehension and 
recall of information for an HIV vaccine trial among women at risk for 
HIV: reading level simplification and inclusion of pictures to illustrate key 
concepts. AIDS Educ Prev 1 999, 1 1 :389-399. 

1 7. Coyne CA, Xu R, Raich P, Plomer K, Dignan M, Wenzel L, Fairclough D, 
Habermann T, Schnell L, Quella S, Cella D, Eastern Cooperative Oncology 
Group: Randomised, controlled trial of an easy-to-read informed consent 
statement for clinical trial participation: a study of the Eastern 
Cooperative Oncology Group. J Clin Oncol 2003, 21:836-842. 

18. Wray RJ, Stryker JE, Winer E, Demetri G, Emmons KM: Do cancer patients 
fully understand clinical trial participation? A pilot study to assess 
informed consent and patient expectations. J Cancer Educ 2007, 22:21-24. 

19. Ives NJ, Troop M, Waters A, Davies S, Higgs S, Esterbrook PJ: Does an HIV 
clinical trial information booklet improve patient knowledge and 
understanding of HIV clinical trials? HIV Med 2001, 2:241-249. 

20. Bjorn E, Rossel P, Holm S: Can the written information to research 
subjects be improved? An empirical study. J Med Ethics 1999, 25:263-267. 

21. Guarino P, Lamping DL, Elbourne D, Carpenter J, Peduzzi P: A brief 
measure of perceived understanding of informed consent in a clinical 
trial was validated. J Clin Epidemiol 2006, 59:608-614. 

22. Ryan RE, Prictor MJ, McLuaghlin KJ, Hill SJ: Audio-visual presentation of 
information for informed consent for participation in clinical trial. 
Cochrane Database Syt Rev 2008, 23:CD003717. 

23. Dunn LB, Lindamer LA, Palmer BW, Schneiderman U, Jeste DV: Enhancing 
comprehension of consent for research in older patients with psychosis: 
a randomised study of novel consent procedure. Am J Psychiatry 2001, 
158:1911-1913. 

24. Knapp P, Raynor DK, Silcock J, Parkinson B: Can user-testing of a clinical 
trial information sheet make it fit-for-purpose? - a randomised 
controlled trial. BMC Med 2011, 9:89. 

25. Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Homes Rovner (vl, Llewellyn 
Thomas H, Lyddiatt A Legare F, Thomson R: Decision aids for people facing health 
treatment or screening decisions. Cochrane Database Syst Rev 201 1, 10CD001431. 



Gillies etal. Trials 2014, 15:62 
http://www.trialsjournal.eom/content/15/1/62 



Page 10 of 10 



26. Abhyankar P: Decision making about cancer treatment and clinical trial 
participation. PhD thesis. Leeds: University of Leeds; 2008. 

27. McCann S, Campbell MK, Entwistle VE: Reasons for participating in 
randomised controlled trials: conditional altruism and considerations for 
self. Trials 2010, 11:31. 

28. Juraskova I, Butow P, Lopez A, Secombe M, Coates A, Boyle F, McCarthy N, 
Reaby L, Forbes JF: Improving informed consent: a pilot of a decision aid 
for women invited to participate in a breast cancer prevention trial 
(IBIS-II DCIS). Health Expect 2008, 1 1:252-262. 

29. Sundaresan P, Turner S, Kneebone A, Pearse M, Butow P: Evaluating the 
utility of a patient decision aid for potential participants of a prostate 
cancer trial (RAVES-ROG 08.03). Radiother Oncol 201 1, 101(3)521-524. 

30. Abhyankar P, Bekker HL, Summers BA, Velikova G: Why values elicitation 
techniques enable people to make informed decisions about cancer trial 
participation. Health Expect 2011, 14:20-32. 

31. Brehaut JC, Lott A, Fergusson DA, Shojania KG, Kimmelman J, Saginur R: 
Can patient decision aids help people make good decisions about 
participating in clinical trials? A study protocol. Implement Sci 2008, 23:38. 

32. Gillies K, Entwistle V: Supporting positive experiences and sustained 
participation in clinical trials: looking beyond information provision. 
J Med Ethics 2012, 38(1 2):751 -756. 

33. Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, 
Barrat A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart 
D, Holmes-Rovner M, Llewellyn-Thomas H, Moujmid N, Mulley A, Ruland C, 
Sepucha K, Sykes A, Whelan T: International Patient Decision Aid Standards 
(IPDAS) Collaboration. Developing a quality criteria framework for patient 
decision aids: online international Delphi consensus process. BMJ 2006, 
333:417. 

34. Brehaut JC, Carroll K, Elwyn G, Saginur R, Kimmelman J, Shojania K, 
Syrowatka A, Nguyen T, Hoe E, Fergusson D: Informed consent documents 
do not encourage good-quality decision making. J Clin Epidemiol 2012, 
65:708-724. 

35. Tait AR, Voepel-Lewis T, Zikmund-Fisher BJ, Fagerlin A: The effect of format 
on parents' understanding of the risks and benefits of clinical research: 

a comparison between text, tables and graphics. J Health Commun 2010, 
15:487-501. 

36. The European Parliament and the Council of the European Union: Directive 
2001/20/EC of the European Parliament and of the Council of 4 April 
2001. CL/EC 2001, 121:34-44. 

37. Flesch-Kincaid readability calculator. http7/www.standards-schmandards. 
com/exhibits/rix/. 

38. Boulos MN: British internet-derived patient information on diabetes 
mellitus: is it readable? Diabetes Technol Ther 2005, 7(3)528-535. 

39. Beardsley E, Jefford M, Mileshkin L: Longer consent forms for clinical trials 
compromise patient understanding: so why are they lengthening? J Clin 
Oncol 2007, 25:el3-el4. 



doi:1 0.1 1 86/1 745-621 5-1 5-62 

Cite this article as: Gillies et al; Patient information leaflets (PILs) for UK 
randomised controlled trials: a feasibility study exploring whether they 
contain information to support decision making about trial participation. 

Trials 2014 1 5:62. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at f \ n! _, ul _-| r Q r,tr=l 

www.biomedcentral.com/submit B,onne «« central 



V 



